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05 ' Abstract 

' ■ 

This paper deals with the problem of perfect sampling from a Gibbs measure with 
f^ ■ infinite range interactions. We present some sufficient conditions for the extinction 

of processes which are like supermartingales when large values are taken. This result 
has deep consequences on perfect simulation, showing that local modifications on the 
interactions of a model do not affect simulability. We also pose the question to optimize 
H I over a class of sequences of sets that influence the sufficient condition for the perfect 

simulation of the Gibbs measure. We completely solve this question both for the long 
range Ising models and for the spin models with finite range interactions. 
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1 Introduction 

In this paper we deal with the problem of perfect simulation of Gibbs measures. The first 
algorithm of this kind was realized by |PW96] . This paper opened a new field of research 
which is evolving in different directions. In |MG98] . the authors extended the results of 
|PW96] to continuous state space. In [HSOOj . the study of perfect sampling from a Gibbs 
measure started and in [DSP08J the authors showed the importance of percolation in perfect 
simulation algorithms for Gibbs measures with finite range interactions. In |CFF02] . the 
authors dealt with long memory processes which means that the state of the process at a 
fixed time depends on all its past history. In |GLU10j . the authors considered the problem 
of perfect sampling from a Gibbs measure with infinite range interactions. 

We start from the paper [GLOlOj and we pose new questions. The algorithm described 
in |GLO10] is based on a probability distribution that we improve. It, in our paper, depends 
on the choice of a sequence of growing sets having appropriate properties. In Section [3l we 
pose the question to optimize over this sequence. We completely solve the problem in the 
case of finite range interactions and in the case of infinite range Ising models (see Theorem 
Hand Remark [2]). In Theorem [6l we show that there always exists an optimal choice that 
in general one is not able to calculate. In Theorem [TJ specialized for the Ising model, we 
make exphcit the best sequence of these growing sets. 

In Section m we present some sufficient conditions for the extinction of a discrete process 
with values in N. Theorem |8] presents this result and it has applications in various areas. 
The assumptions of Theorem [8] are weaker than the ones for the extinction of Galton- 
Watson process which is solved as a particular case (see |Wil91] for Galton- Watson process). 
This result has implications for the perfect simulation algorithm, see Theorem [H because 
it supplies a weaker sufficient condition for the applicability of the algorithm, than the 
condition given in |GLO10] . Finally, we establish an equivalence relation among interactions 
in the sense that two interactions are equivalent if they only differ on a finite region. By 
Theorem HI we prove that, given two equivalent interactions, if one respects the sufficient 
condition for the perfect sampling, then the other one satisfies it too. 

In Appendix lAl we provide the pseudo code of the algorithm, for the Ising model, which 
calculates the optimal sequence of growing sets and, at the same time, builds a perfect 
sampling from the Gibbs measure observed on a finite window. 



2 Synopsis 

Let S = {—1,1}^ be the set of spin configurations. We endow S with S, the cr-algebra 
generated by cyhnders. A point f G Z*^ is called vertex. Let a{v) G {—1,1} be the value 
of the configuration a G S* at vertex v G Z'^, and let a^' G { — 1, 1} be the value of the 
configuration modified in v, i.e. 

cr^(n) = cr{u) for all u ^ v, cr'"{v) = —a{v). 

We write A (s Z'^ to denote that A is a finite subset of Z*^. The cardinality of a set 
A is indicated with |y4|. An interaction is a collection of real numbers J = {Jb G M : 
B^Z'^, \B\ > 2} such that 

sup y^ \B\\Jb\ < oo. (1) 

We denote by J7 the collection of all the interactions. Note that in literature more gen- 
eral definitions of interactions are considered but in our paper we will only use this more 
restrictive definition, as done also in |GLO10] . 

For brevity of notation set Xsio-) = YlveB '^('^) ^'^^ ^^^ -B d Z'^ and cr E S. A probability 
measure vr on (5, S) is said to be a Gibbs measure relative to the interaction J G J" if for 
all f G Z'^ and for any ( E S 

TTiaiv) = av)\criu) = Ciu) \/uy^v) = — ^ a.s. (2) 

1 + exp(-2 )_^B:veB KJbXb[<j))) 

which are called local specifications. 

Let us define the set Av = {B (£ Z'^ : v E B, Jb j^ 0}, for v G Z"^; the set Av is finite 
or countable, therefore we can write Av = {^i,i, : i < N^ + 1} where Ny = \Av\- We now 
introduce a sequence of sets with appropriate properties that will replace the balls with 
distance L^ used in |GLU10j . 

Let B^ = {Byik) (£ Z"^ : A; G N), for t> G Z'^, be a sequence of finite subsets in Z'^ such 
that 

1) 5,(0) = {v}- 

2) By{k) C By{k + 1) and By{k + 1) \ By{k) ^ 0, for A; G N; 



We denote by B^ the space of the sequences verifying 1), 2) and 3). 

In |GLO10] a perfect simulation algorithm for a Gibbs measure vr with long range inter- 
action is presented. It can be divided into two steps: the backward sketch procedure and the 
forward spin procedure. For the applicability of the algorithm they only have to assume a 
condition on the first part, i.e. on the backward sketch procedure. The algorithm is defined 
through a Glauber dynamics having vr as reversible measure. A process {(Jt{v),v G Z'^, t G M) 
taking values in S and having such dynamics, will be constructed. For any v G Z'^, a & S 
and J G JT" let Ct,,j(cr) be the rate at which the spin in v flips when the system is in the 
configuration a, 

c«,j(o-) =exp ( - ^ JBXB{.(y) 

^ B-.veB 

The generator Gj of the process is defined on cylinder functions / : 5 — > M as follows 

Gj/(a) = 5^c.,j(a)[/K)-/M]. 

Assumption ([1]) implies the uniform boundedness of the rates c^,j(a) with respect to v and 
0", and 

sup ^ sup |c^,j(a-) - Cj,,j((t")| < oo. 



Hence, Theorem 3.9 of Lig85 guarantees that Gj is effectively the generator of a Markovian 
process {ot{v\v G Z'^,t G M) having vr as invariant measure. 

The difficulty of dealing with a measure with long range interaction is overcome through 
a decomposition of the rates c^[a^ as a convex combination of local range rates. 

To present the decomposition we define two probability distributions. The first one 
selects a random region of dependence and the second one updates the value of the spins. 
For w G Z"', J G J, let 

if fc = 0, 

Am,B.(^) = { exp(-EB;^PB.B(/B„m \Jb\)~Q^V{-'^Y.B:vGB I^bD if fc = 1, 

\Jb\) \ik>2. 

(3) 



eXp(-2 Y.B:vPB Jb ) 




exp(- Y.B:veB,B<tB,{l) \Jb)- 


-eicg,{-2Y,B:v&B Jb\) 


^W{-Y.B:veB,B^B^{k) J b\) ' 


- exp(— 2^B:veB,B(lB^{k-l) 



Note that, for v G Z'^, {Xv,3,'B^{k) : /c G N) is a probability distribution on N because of 
properties 1), 2) and 3) of B^. 

Moreover, for each v G Z"^, cr G S' and J G JT" let M^^j = '^expi^s veB I'^bD, 

pS,b.(1)=^S,b„(-1) = ^, (4) 

[1] . ^(v)\a) - ^ ^^^^~ ^B:veB,BcB,{l) JBXBJfr)) - exp(- J2B:veB,BcB,{l) W) 

"'^'^^ Mv,J ^-eXp{-2j2B:veB,BcB,il)\JB\)eM-J2B:veB,B^B,(l)\JB\) 

(5) 
and for k >2 

[k] : ^,„,,|^, _ exp(-EB;.gB,iJcB4fc-i)'^^^^(^)) 



6Xp(— l^B:veB,BcB^.{k),B(^B^.{k-l) JbXb{<^)) " exp(— l^B:veB,BcB^{k),B(^By(k-l) \'^b\) 



1 exp( l^B:veB,BcBy{k),B^B^(k-l) \'^b\) 

Finally set for any A; > 1 

It is possible with some calculations to prove that p^ jb„ ^ [0) 1]) thus p[, j b„(~'^('^)I'^) is a 
probability distribution on {—1,1}. The probabilities in dl])-® will be used in the forward 
spin procedure. 

Notice that for each a G { — 1, 1}, pIj b (c^) does not depend on v and that, by construc- 
tion, for any A; > 1, p[,j b (~cr(i;)|o") depends only on the restriction of the configuration a 
to the set B^{k). This is an important property that links the backward sketch procedure 
to the forward spin procedure. 

The announced decomposition of the rates c^^ji^a) is stated in |GLO10] in the following 
proposition. 



Proposition 1. Under condition (CP, the following decomposition holds for any a & S 



Cyi(a) = Myi 



(7) 



fc=i 

Now in |GLU10j there is a construction of an auxiliary process that links the Glauber 
dynamics with the perfect sampling algorithm through decomposition ([7]). 



Later on, for brevity of notation, we will omit the indices J, B^ when there is no 
ambiguity. The backward sketch procedure constructs a process that we are going to define. 
Let My be the mass associated to each vertex v. Let {Cn)n&i be a process with homogeneous 
Markovian dynamics and which takes values on C = {A d Z^}. Let Cq d Z"' the set in 
which we want to observe the perfect sampling from the Gibbs measure with infinite range 
interaction. If C„ = then Cn+i = 0- If C„ 7^ 0, then the set C„+i is constructed as follows. 
A random vertex Wn is selected, proportionally to its mass, with 

nWn = w\Cr:) = ^" ioi WeCn. (8) 

Formula (|8]) will be used to define more general models in Section [51 Then a random value 
Kw^n is drawn by using the probability distribution A^, thus 

F{K^^n = k) = Xy,{k), for keN. 

If K^^n = then Cn+i = C„ \ {w}; if K^^n = k, for k e N+, then C„+i = C„ U B^{K^^n) = 
Cn U Bw{k). The procedure ends at the first time m G N+ such that Cm = 0- When this 
happens, the forward spin procedure begins. Now the value of the spin is assigned to all the 
vertices visited during the first stage, starting at the last vertex with A; = 0. The assignment 
of spins is done by using the update probabilities pi , coming back up to give the definitive 
value of the spin to the vertices belonging to Cq. 

The following proposition characterizes the computability of the algorithm and shows 
that there is an unique condition on the backward sketch procedure and none on the second 
part of the algorithm. 

Proposition 2. The perfect simulation algorithm in IGLOlOf generates a random field with 
distribution it if and only if for any f G Z"^ 

limsupC„ = a.s. (9) 

n— >oo 

Proof. Condition (Q is surely necessary by definition of algorithm. It is also sufficient 
because it means that the backward sketch procedure stops in a finite number of steps 
(almost surely), moreover conditions (P) and pi (-Icr) G [0, 1], which hold by hypothesis and 
by construction respectively, are sufficient for the forward spin procedure. D 

6 



A sufficient condition, given in jGLUlOj . for (^ is 

oo 

(HI) supy^\B:{k)\x,{k)<i, 

vGZ-i fc=l 

where B*{k) is the ball, in norm L^, centered in v with radius k. 

We provide a weaker sufficient condition for ([9]) than (HI) that is presented in the 
following theorem. 

Theorem 1. For a given 3 & J', 

(H2) if a collection {B^ E B^ : v E Z'^} such that 

oo 

lim sup 7 \BJk)\\Jk)<\ 

can be constructed, then ^ holds. Hence (H2) is a sufficient condition for the perfect 
sampling from the Gibbs measure related to J (see Proposition^^) . 

In Section [5] we will give the proof of this theorem. 

Remark 1. For a given 3 E J , if 

oo 

lim sup min > \BJk)\\Jk) < 1, 

then there exists a unique Gibbs measure verifying the local specifications (see ^)- Therefore 
(H2) can be seen also as a sufficient condition for the uniqueness of the Gibbs measure. In 
Theorem\^ we prove that the minimum in the previous expression exists. Hence the results 
on perfect simulation are important also for the study of the transition phase, a classical 
argument of the statistical mechanics. 

3 Stochastic ordering for A^ jb^, and an optimization 
problem for the perfect simulation 

In this section we deal with the optimal choice of B„ G B^, reaching concrete results. We 
start with some definitions. 

7 



Definition 1. For v G Z'*, the sequence B^ G i3„ is less refined ^/ian B'^ G i3^, m symbols 
Bj, ^ B'^, ^/B^ is a subsequence o/B'j,. 

This relation between two sequences of B^ is a partial order. The set B^ has no 
minimum, nor maximum, nor even minimal elements; nevertheless it has an uncountable 
infinite number of maximal elements, corresponding to the sequences of sets which increase 
by only one vertex at a time. 

Let us define, for v G Z*^, a probability distribution obtained from A^^j^^ as follows 

Am,b. (1^^(01 - 1) = A.,j,B„(0, for / G N, 

Kj,bM - 1) = 0, for z ^ {\B,{l)\,le N}. 

Theorem 2. Let v G Z"', J G JT", and Bj,, B'j, G By such that B^, ^ B'j,. T/ien A^^j^b'i, ^st 

At;,J,Bt,- 

Proof. For brevity of notation we write A^ = Aj,^j3^ and A'^ = Xv,j,b'i,- To show the 
stochastic ordering A'^, :<st \v we equivalently prove that for each n eN, 

n n 

F\n) = J2 A'.(0 > Yl ^-(^) = ^(^)- (10) 

1=0 1=0 

The functions F{n) and F'{n) are the cumulative distribution functions relative to A^, and 
A't, respectively. They are piecewise constant functions whose jumps occur only in the points 
of the set {\B^{1)\ - 1,/ G N} and {\B'^{1)\ - 1,/ G N} respectively, i.e. 

n j 

F{n) = ^X(/) = 5]] A^(/), where j = max{/ G N : |5^(/)| - 1 < n}, 
;=o 1=0 

n j' 

F'{n) = ^ A^(/) = ^ A'^(/), where / = max{/ G N : \B'^{1)\ - 1 < n}. 

1=0 1=0 

Now we show that for each m G {|-Bt,(/)| — 1, / G N}, 

F{m) = F\m). (11) 

Let m G {\B^{1)\ - 1,/ G N}, then 

j 
F{m) = 2^ A^(/), where j is the unique index such that \Bv{j)\ — 1 = m, 

1=0 



F'{m) = y^ X'vil), where j' is the unique index such that |-B(,(j')l — ^ = 'm, 

1=0 

from which, by the hypothesis of the theorem, 

B^U) = B'^if). (12) 

Note that the following sums are telescopic, hence 

EAt,(/) = exp I — > \Jb\ ] and > A'(/) = exp I — > \Jb\ ] , 

1=0 ^ ^ 1=0 ^ ' 

(13) 
for n G N+. Moreover F(0) = A„(0) = A„(0) = A;(0) = A'^(O) = F'(0). 
From (|T2|) and (|T3|), 



1=0 1=0 

immediately follows and it implies (TTT]) . Since F and F' are nondecreasing, from (TTT!) and 

{|5,(/)|,/GN}c{|i?;(/)|,/GN} 
we obtain (HD]). D 

Analogously to [GLOlOj . see (HI), we introduce the following quantity that will be used 
later; we call it birth-death expectation, 

oo 

/i,,j(Bj = J]|5,(/)|A,,j,B.(/)-l, 
1=1 

for 3 ej,ve Z*^, B^ G B^. 

We are now in the position to present our result concerning the birth-death expectation, 
it will be involved in conditions (HI) and (H2) for the perfect sampling. 

Corollary 1. Let 3 E J, v E Z'^, B^, B'^ G E„ such that B^ ^ B'^. Then fiy,j{B'^) < 

Proof. Let 3 E J', v E Z*^, B^, B'^ G By such that B^ ^ B'„ and let A^, = A^^j^b^, 
A'u = A^,j3/„ be the corresponding measures. Consider two random variables Xy ~^ A„ and 



X'y r^'~ \'y. From Theorem [2], it follows that E(/(X„)) > E(/(X^)) for each nondecreasing 
function / : N ^ M. Note that 

oo oo 

/i,,j(B,) = Y, \BviS)\\.{l) - 1 = 5^(1^.(01 - 1)A.(/) - A,(0) (14) 

i=\ 1=1 

C!0 OO OO 

= Y,{\B,{1)\ - l)A,(|i?„(/)| - 1) - A,(0) = ^(z - l)A,(z - 1) - A,(0) = J^' X,{t) - \(0), 

1=1 i=l i=l 

therefore flT^ is the expected value of the random variable g{Xy) where, 

9i^) = \ . .,.^; (15) 

I z if « > 1. 

The function in (fT5|) is nondecreasing. Thus, by the stochastic ordering, /i^j(B'j,) = 
E(5(X;))<E(^(X,))=/i,,j(B,). D 

By the next two theorems, we will see that if an interaction J verifies (HI), then all the 
interactions obtained from J by changing them on a finite region and by lowing them in 
absolute value elsewhere, still verify (H2). By Theorem [H all the Gibbs measures associated 
to these interactions are perfectly simulable. 

Theorem 3. Let v G Z'^, B,„ e B^, 3,3 e J such that \Jb\ < \Jb\ for each B d Z'^. Then 
\j,B„ -St Ai,,j,B„- Hence /i^_j(B^) < ^i^^jiB^). 

Proof. For brevity of notation we write A^ = A.t,^j3,„ and A^, = A^ j ^ . To show the stochastic 
ordering, we equivalently prove that for each v G Z'^, n G N 

n n 

1=0 1=0 

Since \Jb\ < \Jb\ for each B d Z'^, then 

A.(0) = exp {-2J2^,^^^ \Jb\) > exp {-2^2^,^^^ UbI) = A.(0), 
and for n > 1 

vx(o = exp(-y |jBi)>exp(-y \jb\] =y"K{i). 

^-^ ^ ' \ ^-^B:veB,Bi^B^(n) ' ^'J - ^ ^ ^-^ B:veB,B<^B^,{n) ' 'J ^^-^ ^ ' 

D 
10 



The following result is directly related to our sufficient condition (H2). 

Theorem 4. Given the interactions J, J G JT", if the cardinality of C = {B d Z'^ : \Jb\ 7^ 
\Jb\} is finite, then for v ^Tf and B^ G i3^, 

lim sup/ij,,j(B^) = lim supu j(B^). (16) 

Proof. Note that the measures Ai,,j3„, A^jg are equal for each v such that all the finite 
subsets B containing v do not belong to C. In fact if {B d Z"' : 1; G 5, -B G C} = 0, then for 
each B including v we have \Jb\ = \Jb\, hence A„^j^b„ ~ -^jjjb ^'-'^ each A; > 0. Therefore 
for A D Usee B, 

00 00 

sup/i^,j(B„) + 1 = sup^|5^(A;)|A^,j,B„(fc) = sup ^ |5^(fc)|A^ 5 b^(A;) = supyU^j(B^) + 1. 

(17) 
Since the cardinality of C is finite, then [JBec ^ ^^ finite. Therefore, passing to the limit in 
([nD for A t Z'^, we obtain ([16]). D 

Condition (H2) says that lim^-j-^d supj,^^/i^,j(B^) < 0, therefore we are interested in 
finding the infimum value inf xgB„ IJ'v,j (x) . 

We define S^ by distinguishing two cases A^^, = 00, A^^, < 00. In the ffist case let S^ be 
a subset of B^ such that each element {B^{l))i^fq G S^ has the property that there exists a 
sequence {ik)ke'N where B^{1) = IJfc=i ^ik,v ^^ ^ ^ ^+- When A"^ < 00, let £jj be a subset of 
B^ such that each element {By{l))i^^ G Sy has the property that 

31 : B,{1) = [j Ak,., 3(^1, . . . , 2;-) : B,{1) = \J A^,, V/ < I. (18) 

fc=i fc=i 

We notice that, for each / > J, A^(/) = for any choice of By{l) verifying 2). 

In the next theorem we restrict the research of the infimum from B^ to £y. This produces 
a sensitive improvement when A^^ is finite for each vertex f G Z"' , in this case the infimum 
is a minimum because there is a finite number of choices in flTSl) . and this fact allows us to 
calculate it. In any case, in Theorem [6] we will prove that the minimum of /i^_j(x) always 
exists. 

We endow B^ with the discrete topology to consider the limit of a sequence in By in the 
next two theorems. 

11 



Theorem 5. Let J G JT", f G Z"^, then 

inf Ai^,j(x) = inf /i,,,j(x). 

xgB„ xe£t, 

Proof. First we consider the case N^ = oo. To prove the theorem we wiU show that for each 

yi E Bv there exists y E S^ such that yUt,,j(y) < yUt,,j(x). Starting from x = (x(/));gN G B^, 

we will construct a sequence of points (x*^") G Bv)nm such that x*^*^^ = x and lim^^oox'^"^ = 

y E £y. We will prove that, for n eN, yU.„ j(x'^"+-'^)) < yUt,^j(x*^")) and then, by Fatou's lemma, 

fJ'v,j(j) < liminf„_^oo/Ui),j(x^"-')7 from which /U^,j(y) < /ij,,j(x). 

Let x^^^) = X = (x(/))igN G i3„, we now give the rules to construct x'^-'^^ Define 

j 
fco = 1 + sup{/ G N+ : 3(zi, . . . , ^^) s.t. x(j) = [J Ai^^y for any j = 1, . . . , /}, 

fe=i 

if fco = oo, then x G £"1, and there is nothing to prove, li ko < 00 then define the finite sets 

of indices 

I = {iEN+: Ai^y C x(fco)}, 

r = {tEN+: Ai^y C x{kQ - 1)}. 

If / = /~ then eliminate x(A;o) from the sequence obtaining x^^\l) = x{l), for I < ko — I, 
x^^\l) = x{l + 1), for / > kQ. In this case /i^,j(x(°)) = /i„,j(x(^)). 

If / 7^ /~, consider j = minji : i E I \ I^}, define x^^\l) = x{l), for I < ko — 1, 
x^^Hko) = x{ko — 1) U Aj^y, x^^\l) = x{l — 1), for I > ko + 1. It is easy to check that the 
sequence x*^^) verify the conditions 1), 2) and 3) defining By. In this case the sequence x^^^ 
is less refined than x^^\ therefore /i^,^ j (x*^°^ ) > yU.„ j(x^^^), by Corollary [TJ 

We repeat the procedure to construct x^"'*'^-' from x^"-*, for any n E N+. Obviously 
there exists lim„_j,oo x*^") = y G £^t,. Since \y^j,z{0) does not depend on z G i3t, we set 
A^,j(0) = A^,j,z(0), therefore we can write 

00 00 

Ait;,j(y) = -^M,y(0) + y^^-^M,y(0 = ->'v,j{0) + Y^liminf zA^ j (n)(i) 

i=l i=l 

00 

< -A^,,j(0) + liminf V'zA^ jx(„)(z) = liminf /i„,j(x(")) < fiy,j{x), 

i=l 

where the first inequality follows by Fatou's lemma. The case A'^y < 00 is simpler and in a 
finite number no of steps one obtains that x'^"''^ G £v D 

12 



Now we state the theorem on the mininiuni that has a theoretical flavor but we will see 
that in some important cases the point realizing the minimum can be explicitly calculated. 

Theorem 6. Let J E J', v E U^ , then 

min/Xi,,j(x) = min/i^,j(x). 

Proof. The theorem is obviously true in the case of A^^ < oo, thus we consider N^ = oo. 
First we prove the existence of miUxgH^ /ij, j(x). If for each x G S^,, /i^ j(x) = oo, there is 
nothing to show. Suppose that for x = {x{l))i^pi, 

Ai?;,j(x) < c < oo. 

Define, for any A^^v ^ ^v, 

l{k) = mm{l E N : x{l) D Ak,v}, 

therefore 

Ak,,<^x{l{k)-l), Ak,,Cx{l{k)). (19) 

We will prove that for each k E N+ 

m < ^U\^ 1 V 2, (20) 

whereL = ^^^^g^|JB|. 
Since /i„ j(x) < c, then 

CXI 

([(A;) + l)A,,j,x(/lA;)) < J^ H^)\KjA^) = /"mW + 1 < c+ 1, (21) 

1=1 

where the first inequality is true because we have only taken a term of the sum and used 

that |x(/)| > / + 1. 

Let Sk = T.B:veB,B^x{k-i) \Jb\- Since Sk E [0,L], then 

e-^+1-^-^..J - e"^ < e-^^+l-^^^.-l - e'^^ < X,,3Mk)), (22) 

where the last inequality follows from flTOl) and from the expression of At,_j,x(/) (see ([3])) for 
/ > 2. By ([21]) and ([22]) we obtain 

([(A;) + l)(e-^+l'^-^fc>''l - e"^) < c + 1, 
13 



which imphes f EU]) . 

Now define a sequence (x*^") E B^ : n E N), such that x*^*^) = x, the birth-death ex- 
pectations /i^^j(x*^"')) are nonincreasing in n and hm„^oo Att),j(x''"^) = inf xee„ /^i;, J (x) . Let 
r(")(/c) = min{Z E N : a;(")(/) D Ak,^} the analogous of l{k). By ([20]) there exists a sub- 
sequence (x^" G i3t, : n G N) of (x*^") E By : n E N) such that r'^"''(l) is constant in n. 
For each h E N+ there exists a subsequence (xj^"' G i3^ : ra G N) of {x.]^_i E By : n E N) 
such that B'^\h) is constant in n. Therefore, by using diagonal method, the sequence 
(xn E By : n E N) admits limit, i.e. 

lim x^f) =yEBy. 

n—>ca 

The sequence (x„ G iS^, : n G N) is a subsequence of the initial one (x*^") E By : n E N); 
hence /ij,^j(xn ) is nonincreasing in n and lim„-^oo/^^,j(xrr ) = infxgs^ /i,;,j(x). Now, by 
Fatou's Lemma, 

oo oo 

/ii,,j(y) = -A^,,j,y(0) + y^iK,3,y{i) = -Aj,,j(0) + V'liminf zA . (n)(i) 

oo 

< -A^,j(0) + lim inf ^ iA („) (z) = liminf /i^,j(x^"^) = inf /i,;,j(x). 

n— >-oo •'— » ''i-'i-^n n^cx) xGi3« 



Therefore 



Aii>,j(y) = inf yUt,,j(x), (23) 

xeBu 



that implies the existence of the minimum on By . 

For y G i3^ as in (125]) . there exists z E Sy such that /it,,j(y) > ;U^,j(z) (see the proof of 
Theorem E]). It is immediately seen that yU^ j(z) = infxe^:^ /i^, j(x). D 

In some cases it is possible to identify the sequence Zy E By such that fiy^j{zy) = 
miUxgB^ /i^_j(x). We present a result on the Ising models in which it occurs. Let 1/2 C ^7 be 
the set of the interactions such that 

Jb^O^ \B\ = 2. 

Note that under condition ([1]) one gets 

lim sup Jsy u| = for all v E Z'^, 
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therefore it can be written, for a fixed vertex v, 

\J{v,wi}\ > \J{v,W2}\ > • • • > |-^{i),toj| > • • • (24) 

where IJi^i "^i — ^'^ ^^^ ^j ¥" ^j if ^ ¥" J- Let (w„ E Z'^ : n E N+) be the sequence written 
in flMj) and define z^, G i3t, such that, for i G N+, 



2;„(i) = {v,wi,...,Wi}. 

;^,,^„„}| for n G 
sequence (w„ eU^ : n E N+) is not in general unique. 



Let also Jv = \J{v,w^}\ for n G N+. We remark that, given an interaction J G J72, the 



Theorem 7. Let J G J2; /c"^ eac/i f G Z , 



CXD 

At«,j(z»;) = min/i^,j(x) = -2e ^^^^i-^" +e ^«=2-^'' +Z^M'^ z.i^i+i-^" -e ^«=!-^'' j. 

1=2 

(25) 

Proof. First notice that z„ is a maximal element of B^ and z^ G £^t,, moreover A^,^j^z^ = At,^j^z„. 
To prove the theorem we will show that, for each maximal element x G -B„, we obtain 
Ai,,j,z„ ^st At,^j^x- Hence by Theorem |2] we will get the first equality of (125]) . 

Let X be a maximal element of i3^, as in the proof of Theorem |2l we show that for any 

n n 

5^A,,j,z„(/)>5^A,,j,x(/), (26) 

1=0 1=0 

which guarantees the stochastic ordering. The l.h.s. of fj26|) is 

Consider the sequence of distinct vertices {n„ E Z'^ : n E N+} such that uq = {v} and 
Un = x{n) \ x{n — 1). Since the r.h.s. of (126!) can be written 



exp ( - y^ \Jb\ I = exp - ^^ I J/^, 



"ill 
l=n+l 
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then inequality I^E^ is equivalent to 

(oo \ / oo 

~ X^ \'^{v,m}\ ) > exp I - ^ \J{v,ui}\ 
l=n+l J \ l=n+l 

or 

exp f J^ \J{v,w,}\ j > exp I ^ \J{v,u,}\ 

that is obviously true by using the definition of sequence {wn} (see 

The second equality in ( 12^ follows by elementary calculations. D 

Remark 2. If for any v E Z'^ the number Ny is small and if it can be proved that for some 

lim supyu^,j(x^,) < 0, (27) 



then the perfect simulation algorithm can be run. Proving (27\ ) is a little easier than proving 
condition (HI), and in both cases it should be done a priori. In the backward sketch procedure 
a random vertex w is selected with probability ^, now the algorithm calculates all the x^„ 's 
belonging to argmiuxg^^, /iw.j(x) with a finite number of elementary operations because, for 
any x G 8^, ^w,3,xil) rnust be calculated for I = 1, . . . , N^ and also all the sums involved 
in the definition of Xw,3,:x. and o//i^_j(x) are finite. Moreover \£yj\ < Nyj\. By comparing 
the finite list (having at most N^l elements) of fi^^jix.) with x G S^, the algorithm finds all 
the x^ 's belonging to E^ such that \iw,3^w) = minxg£:,„ yU^,j(x). This procedure is repeated 
for all the selected vertices, which are almost surely finite. Hence the problem is computable 
and the previous procedure is really an algorithm. The computability is guaranteed by the 
fact that Ny is finite, further the algorithm runs in reasonable time if Ny is small. 

If Ny is large or equal to infinity, if one succeeds in calculating a (xt, G By)y^^d such 
that condition (22) is satisfied, then the algorithm can use this particular choice. 



The case Ny = oo is in some sense theoretical but there are models in which a change of 
the first terms of a given sequence Bj, may produce a sensitive improvement for fiy^j(By), 
i.e. it goes from positive values to negative values. For simplicity of the exposition we only 
consider translation invariant models. Let us assume that, for a fixed Bj, G By, 

oo 

EI^-(^)IVb.(^)<^- (28) 

fc=i 
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Hence, for N E N, we consider the finite subset Tjv(B^) of By made by all the sequences 
verifying these rules: 

• By{0) C By{l) C . . . C By{L) = By{N), with L = \By{N)\ - 1; 

• B.,{L + i)= By{N + i), for i > 1. 

It is easy to calculate 

min /ij,,j(x), 

and for each x G Tn(Bv) there exists y G Tiv+i(Bt,) that is more refined than x. Therefore 
increasing N the minimum in the previous formula can only decrease, via Theorem 

We conclude with a more explicit example. Let d = 2, consider B*„ (the sequence of 
balls chosen in IGLOIC^ ). suppose that (d^ holds and take N = 1. Note that B*^ is less 
refined than each sequence in Ti(B*„). With simple calculations we obtain 

3 

/x,,j(B,) = /i.,j(B%) - 5^(|5:(1)| - |5,(0|)A,^j3^(0, (29) 

where B„ G Ti(B%). 

Notice that \B*{1)\ = 5 and (|S*(1)| - \By{i)\) > 1 for i = 1,2,3. Now one can take 
By[l) , By{2) , By{3) , By{4) among the 4! possible choices selecting the one which maximizes 
the sum in ^29\) . For some interactions J G JT" the next inequalities yU^^j(B*„) > and 
yU^^j(B^) < hold. 

4 A general result on the extinction of a population 

The following theorem gives a generalization of the extinction result on Galton- Watson's 
process and it apphes to processes that behave like a supermartingale when they assume 
large values. 

In the following theorem we will write for brevity of notation i{^ in place of the vector 
[ih, ■■■,ik), for h < k. Furthermore, the equalities or inequalities between conditioned prob- 
abilities have to be considered valid only if the conditioning events have positive measure. 

For each null event A we pose P(-|A) = 1, in this way we can write the infimum in place 
of the essential infimum. 
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Theorem 8. Let X = (X„ : n E N) be a stochastic process over N. Suppose that there 
exists N E N such that the following relations hold: 

1) P(X„+i = 0|X„ = 0) = 1, for n e N; 

2) for i < N there exists rii G N+ such that 

Qi = infmGN,Jo,...,im-ieN+IP(-^m+ni = 0|Xo = Iq, . . . , X^ = im) > 0, Im = i] 

3) E(X„+i|Xo = io,...,Xn = in) < V a.s. for nEN, io,..., 2„_i G N, 2„ > N; 

4) Pi = infmGN,io,.--,i™-i6N+IP(-^m+l 7^ ^|-^0 = "^0; • • • ; ^m = im) > 0, i^ = i > N. 

Then 

liin Xn = a.s. 

n—^oo 

Proof Let A = {0, 1, ..., N}, B = {N + 1, N + 2, ...} where N is given in the theorem. Let 
us define 

Tili^ = inf{n > : X„ G 5}, T^^\^ = mi{n > T^^Ib ■ Xn G A}, 
t£^ = inf{n > Ti.'^i^ X„ G 5}, T^'i^ = inf{n > t£^ : X„ G A}, 



for /i > 2. 

The random variables T^J.^, ^B-i>yi' ^^^ QO-ch h > 1, are stopping time. We put T^J.^ = 
oo if the set, on which the infimum is defined, is empty or if Tj^^J = oo. Similarly we write 
Tg^^ = oo if the set, on which the infimum is defined, is empty or if Tj^\^ = oo. The 
following inequalities are obtained directly by definitions in ( 130|1 

^ A-^B — ^B^A — ^ A^B ^ • • • ^ -'A-s-B — ^ B^A ^ • • • 

The previous inequalities are strict until one of these stopping times becomes infinite. 

Let us define the stopped process {Yn = X (m) : n G N) on {T^r!^ < oo}, for 
m G N+. We do a partition of {T^^ < oo} in the sets {{T^^ = k} : k E N_|_}. On every 
set {T^^ = k}, the elements of A are absorbing states for Yn when n > k, therefore 
{Yn }n>k is a non-negative supermartingale on {T^^ = k}, by hypothesis 3). Thus, see 
|Wil91j . there exists 

lim ri'") < oo on {T^^s < oo} a.s. (31) 



We will prove that the limit in flHT]) belongs to A almost surely. 

Given k E N+, we prove (1311) on the set {T^^ = k}. In fact Hi E B 



oo oo 

(m) 



u ni^i'"^=^} 

h=k+l n=h 






oo ^ oo \ oo oo 

< E P( n i^i'"^ = ^i^B = fc < E n nr!^"^^ = ^\Yt^ = ■■■ = yS = z,7ll 

h=k+l ^n=h ^ h=k+\r=h+\ 



= E n ^^^^- = ^1^^ = . . . = X,_i = z,Ti'!,^5 = A;) , (32) 

h=k+l r=h+l 

where the last equality is a consequence of the fact that, if the limit belonged to B, then 
the process {Xn)n>k would never visit A and so, in this case, the processes {Yn )n>k and 
{Xn)n>k would coincide. Now, by using hypothesis 4) and a standard argument on the 
partition of the trajectories, we obtain the following upper bound for fl32l) 

oo oo 



k) 



E ll(^-Pi) = 0. (33) 



h=k+lr=h 



Hence we get that 
or equivalently that 
from which 



lim Fj™) EAa.s. 



P({T 



i™)^ < oo} \ {TirJ^ < oo} ) = 0, 



n-\Tt-B^ < oo) = p(-iTjrri^ < oo). (34) 

Notice that, if the numbers rii, for i = 0, . . . ,N, verify hypothesis 2) of the theorem, 
then, by taking n > max{nj : i < N}, condition 2) is still verified. In fact, if the process 
visits the state zero, then it indefinitely remains in zero, which directly follows by hypothesis 
1). Therefore let us define n = max{?T,j : i < N} E N+, then hypothesis 2) is satisfied by 
using n instead of rii where the values of the g^'s can only increase by replacing all the n^'s 
with n. Hence all the g^'s calculated setting rii = n are greater than some positive constant q 
which can be chosen equal to inf{gj : i = 1, . . . , A^}. 
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Then we get, by ([31D, that for k e N+ 

^(^j^ak+m ^ oo|tS < oo) = P(T£-y)^) = oo\tI,''1\ < oo). 

By denoting the set of trajectories Mn,k = {io ^ N*^ '■ {Xq = Iq} C {Tj^^\ = n}}, from the 
previous relation we obtain 

oo 

n=l iJ^GM„,fe 

oo 

>J2Y. ^(^"+" = 0|X^ = iS)P(TS = n,X- = i^lTS < oo) > g > 0. 

n=l iJjGAf„,fc 

Thus indicating m = \n/n\ for a generic n G N+, we obtain the following relation 

m 

^T^aIb < oo) < n^rS < oo|r£-^^)^) < oo) < (1 - g)™-^ 

fe=2 

Since, for each n G N+, {T^^^ < 00} D {Tj^_^J < 00}, by the monotone convergence 
theorem 

Pf n{^i"lB < 00}) = lim P(Tj!ls < 00) < lim (1 - g)L"/"J-i = Q. 

V ' ' / n— >+oo n— >+oo 

Hence almost surely there exists a finite random index S" = 2, 3, . . . such that Tj^^J < 00, 
Tg^^ < 00 and T^^^ = 00, then X„ G A for any n > Tg_^^ . It remains to show that the 
process can not stay indefinitely in {1, 2, ... , A^}. 
Let us define 

Xk = XkH, for keN. 

Note that for the process X = (X„ : ra G N) there exists a random time almost surely finite 

Ta = inf{n : X^ G A, for k > n}, 

such that the process remains indefinitely in A after Ta- Moreover observe that T4 is not a 
stopping time and it shall be taken into account the information provided by the value of 
Ta- Directly from hypothesis 2) it follows that 

Q = infmeN,Jo,Ji,-,im-ieN,i™eAlP(-^m+i = 0|X™ = i^^) 
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is positive. 

Now we will show that for each n G N+, 

We notice that for ig^^ G N"~\ z„_i G 5, Zn, • • • , im e A, 



from which 



Hence 

P(X„+i=0|fk = n,X™ = i; 



Xo"^ = i^,X„+i=0)<P(TA = n). 

P(Ti4 = n,X- = i™,X„+i=0) 



P(Ta = n, X^ = ig^) 



m ;m\ 



_ P(X[}' - i[}',X„+i - 0) P(X[}' - i[J',X„+i - 0) _ , ~ _ I 

From which by taking the infimum, 

infm>n,iJ,^-2eN"-i,i„_ieB,i„,...,J™e^^(^'»+i = ^1^^ = n,X^ = i^) 

^ l^fm>n,iJf-26N"-l,i„_ieB,i„,...,weA^P(^m+l = Ol^cT = O 

> infm,gN^jQ^j^^...^j^_-^gN,i™gAlP(-^m+i = 0|X™ = i™) = g > 0. 

Analogously to (133|) . by the latter inequalities and standard arguments on the partition of 
trajectories, one obtains that the process X is eventually equal to zero. Obviously the same 
property is obtained for the original process X, i.e. lim„_j.+oo Xn = a.s. D 

Remark 3. We note that, in the previous theorem, the process {Xn)n&N could be a non- 
homogeneous Markov chain. In particular, one can consider a culture of bacteria in which 
the number of its population affects the ability of reproduction of the bacteria by changing 
the probability that the cell dies before its mitosis. In some way we can think that a pro- 
cess {Xn)neN, verifying the assumptions of Theorem\^ can be chosen as a model for these 
biological cultures. Therefore the bacteria cultures will die in a finite time. 
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5 Applications of Theorem M to perfect simulation 

Let us consider a probability distribution ip^ indexed by i; G Z*^ and let ^;^o'^^(0 = 1- 
Moreover, for each v G Z"^, let ipv{^) > 0. 

Let us associate to each vertex v E Z'^ a. sequence Sy = {Sy{l) (£ Z'^ : I E N+) and a mass 
M„ such that inf^g^d M^ > 1. 

Let V E TJ^ and {Dn)n&^ be a homogeneous Markov chain with countable state space 

At time zero the Markov chain has a initial measure h''^'^\ The rules of the dynamics are 
given in Section [21 it only needs to replace C„, B^, A^, with D„, S^,, tp^ respectively. 
Let us define, for each v eU^, 

oo 

^. = -V'.(0) + 5^|5,(0|^.(/), (35) 

1=1 

which is similar to the birth-death expectation and plays the same role. 

We are now in the position to present our result on the extinction of the processes above 
defined. 

Corollary 2. Let rj^ as in (E3J, ^/ hmAi-zd sup^,^^ ?7^ < 0, then lim sup^^^^ i5„ = almost 
surely. 

Proof. Let X„ = |-D„|, we want to show that the process {Xn)n&i verifies all the hypotheses 
of Theorem [HI Hypothesis 1) is trivially verified because if Dn = 0, then -D„+i = • We now 
verify hypothesis 3). First of all note that from the assumption of the corollary it follows 
the existence of a 5 > such that the set 

Rs = {vEZ'^: r]„ > -5} 

has finite cardinality. 

Fix 6 > such that \Rs\ < oo, and define a = max{0, MyTj^ : v E Rs}- Consider D^ 7^ 0, 
we easily see that 

E(X,+i|D„) = E(|D„+i| |D„) < |DJ + J2 V ^'''^• 



veDn 
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Under the assumption of the corollary and since M^ > 1 for each v G Z'^, we obtain 
E(X„+i|D„) < \D^\ + ^ [a\Rs\ - 6i\Dr,\ - \Rs\)] . 

We get that if 

Xn = \D„,\ > — h \R, 



S 



5\ 



N, (36) 



then E(X„+i|D„) < X„. Since 



E(X„+i|X^ = iS)= Yl E(X„+i|^n = A)Ppn = v4|X^ = iS), (37) 

AimZ'':\A\=i„ 

we have that (157|) is lesser or equal to X„ = i„ when i„ > A^. Hence hypothesis 3) is 
obtained by choosing A^ as in (I5B1) . because all the summands in ([27]) are non-positive. 
Now we show that 

C = inf ip^{0) > 0. 

Note that 

p = inf{V'^(0) ■.veRs}>0 

because it is an infimum on a finite set of positive numbers. Moreover, from ( 135|) . it follows 

p = inf{^^(0) : V e Rs} > 6 > 0. 

Hence 

^ = min{p, p'} > 0. 

Therefore hypothesis 2) is verified for rii = N and the g^'s are larger or equal than ^^ > 0, 
for i < N. 

We also obtain 4) observing that Pi > ^ > for each i G N+. 

Thus, from Theorem [HI 

lim Xn = a.s. 

n—^+oo 

There exists an almost surely finite random time Y such that Cy = 0. □ 

Given 3 e J, v e Z'^, B^ e B^, set 

S,(/) = 5,(/)\Mfor/GN+, 

and-ipy = A^,j_B„, then, by a simple calculation, rj^ = /i^j(B^). Putting M„ = 2exp(^^^gg \Jb\), 
for each u G Z'', and z/^^^ = 5co the process {Dn)n coincides with (C„)„ defined in Section [2j 
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Proof of TheoremUi The first part of Tlieoreni[T]is a direct consequence of Corollary [21 D 

We conclude the paper discussing an example in which an interaction verifies hypothesis 
(H2) but does not verify (HI). The example is constructed by using the property of univer- 
sality described in Theorem HI Let B^,'s be fixed, let us consider an interaction J G JT" such 
that the inequality in (HI) is verified. For a given Bq d Z'^ such that O E Bq, define J'-'^-' as 

j{L) _ \ Jb if B y^ Bq; 
"" ~\ LJb iiB = Bo; 

where L E M.. By elementary calculations, for a sufficiently large L > 0, it occurs that 
yUo,j(i)(Bo) > 0, hence sup^g^d /i^ j(l)(B^) > 0. Instead limA|Z'' sup^^^/i^_j(L)(B„) does not 
depend on L, therefore it is less than zero. 

Other examples, verifying (H2) but not (HI), can be naturally constructed for each 
result in Section [3] following the scheme of the proofs and choosing suitable values for the 
J's and the B^^'s. 

We notice that Theorem [8], by eliminating anyone of its assumptions, becomes false; 
examples can be easily constructed. 

To finish we stress that condition (H2) differs from (HI) for two reasons. First, the 
replacement of the supremum by the limit superior improves the sufficient condition for 
the applicability of the algorithm, but does not change the algorithm; second the different 
choice of the sets B„'s improves the algorithm and its applicability. 

A Algorithm for the infinite range Ising model 

We present the algorithm for the infinite range Ising model showing how to implement the 
result presented in Theorem [7] in a pseudo code. First one has to prove that, given the 
interaction J G J72, 

oo 

limsup-2e ^^»=i'^" +e ^»=2-^" +N l(e ^i^'+i-^" -e ^«=i'^" < 0. 

If one does not use the finite range approximation presented in |GLU10] . it is important 
that the sums G'j(f) = ^yi^i,<^\u\--^{v,v'}\ are calculable for each v E U^ and that these 
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values are given as input in the algorithm. The easiest case is the translational one where 

J{u,v} = J{u+w,v+w}, for any u,v,w E Z"'. 

D, H, I, K, L, N, NsTOP) R are variables taking values in N; 

f/ is a variable taking values in [0, 1]; 

V is a variable taking values in Z'^; 

y is a variable taking values in { — 1, 1}; 

M, Mq are variables taking values in M; 

C, S, W, Z_, Z+ are arrays of elements of Z'^; 

Q is an array of elements of Z"^ x N x {i^ d Z"^}^; 

G is a function from Z'^ to M; 

F is a function from Z'^ x N to [0, 1]; 

P is a function from N x Z'^ x {E d Z'^}^ x {-1, 1}^' to [0, 1]; 

T is a bijective function from N to Z^; 

X is a function from Z^to{ — 1,1}UA where A is an extra symbol that does not belong 

to { — 1,1} and it is called cemetery state; 

RANDOM is a uniform random variable in [0, 1]. 

Algorithm 1: backward sketch procedure plus construction of optimal B„'s 
Input: J eJ2;C = {Vi,.. . , V[c|); G{V) = Ey'ezd\v \J{v,V'}\; 
Output: NsTOP] Q; 

1. N ^0; NsTOP ^ 0; Q ^ dl; D ^ \C\; 

2. WHILE C ^ 

3. N ^ N + l; R^l; M ^0; Mq^O; S ^^■, 
A. U ^ RANDOMO; 

5. WHILE ES=i2exp(G'(Vi,))/ESi2exp(G'(y,)) < U 

6. R<- R+l; 

7. END WHILE 

8. K ^0; 

9. F{VR,0)^exp{-2G{VR)y, 

10. WHILE F{Vr, K) <U 

11. K i- K + 1; L^l; 

12. WHILE G{Vr) -M- Eti \J{Va,Tr+Vn}\nTi ^ S) > 
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m£ix{\J{VR,Ti+VH}\ : / = 1, . . . , L, Ti ^ S} 

13. L^L + 1; 

14. Mo ^ max{| J{y^,T^+y^}| : / = 1, . . . , L, Tj ^ S}; 

15. END WHILE 

16. A ^ min{/ = 1, . . . , L, T, ^ 5 : | J{y^,T,+yH}| = Mq}; 

17. M^M+|J|v^,T^+y^}|; 

18. S^SUiTA + Vn); 

19. l^i, ^ T^ + V^; 

20. F(\/^,ir) ^exp(-G(\/^) + Ef=ilV«wl); 

21. END WHILE 

22. IF ir = 

23. C^C\ Vr; 

24. ELSE 

25. FOR J = 1,...,L; 

26. C ^ C U Wi; 

27. END FOR 

28. END IF 

29. g(iV) ^ (Vr, K, U?=i' W^/, U/=i Wi); 

30. END WHILE 

31. NsTOP ^ N; 

32. RETURN Nstop] Q- 

Algorithm 2: forward spin assignment procedure 

Input: Nstop; Q; 

Output: {X{Vi),...,X{Vd)}; 

33. A^ ^ A^5TOp; 

34. X(j) ^ A for all j G Z'^; 

35. WHILE A^ > 1 

36. {V,K,Z^,Z+)^Q{N); 

37. f/ ^ RANDOMO; 

38. IFO<f/<P|fi_^J-X(\/)|X) 
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39. Y = -1; 

40. ELSE y = 1; 

41. END IF 

42. XiV) ^Y ■1{K = Q)+ XiV) -Y ■1{K> 0); 

43. A^^ A^-1; 

44. END WHILE 

45. RETURN {XiVi), . . . , X(Vd)}. 

We write some comments to facilitate the understanding of the pseudo code. 
Line 2. the b.s.p. ends when the set C becomes empty. 
Lines 5.-7. a random vertex Vr in C is chosen with probability given in (jH]). 
Lines 10.-21. a random value K, related to the vertex Vr, is selected by Skorohod repre- 
sentation that uses Fvj^{K) the cumulative distribution of A (see (|3])). Notice that, for each 
fc, Fyj^{k) can be calculated with a finite number of elementary operations, when G{v) is 
known. 

Lines 12.-15. it is a small algorithm that finds for a positive sequence {anjneN with 
L = J2neN o.n < oo the biggest element an = max{a„ : n G N} and the index n. We 
stress that it is done in a finite number of steps. Iteratively the second biggest element is 
calculated and so on. 

Line 38. The probabilities p\,3-B^{—(y{v)\a) defined in ([5])-([6]) depend on the finite sets 
By[k — 1) and By{k) that in the pseudo code are Z_ and Z+ respectively. In the pseudo 
code these probabilities are Pyz_ z (~"^(^)l"^)- ^^ © and ([6]) all the sums have a finite 
number of elements, except one in (^ that can be rewritten as —G{v) + J^ueB^ii) \J{v,u}\^ 
which has a finite number of addenda. 
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